Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation

نویسندگان

چکیده

In this article, we propose a fully automatic system for generating comic books from videos without any human intervention. Given an input video along with its subtitles, our approach first extracts informative keyframes by analyzing the subtitles and stylizes into comic-style images. Then, novel multi-page layout framework that can allocate images across multiple pages synthesize visually interesting layouts based on rich semantics of (e.g., importance inter-image relation). Finally, as opposed to using same type balloon in previous works, emotion-aware generation method create different types word balloons emotion audio. Our is able vary shapes sizes response emotions, leading more enriched reading experience. Once are generated, they placed adjacent their corresponding speakers via speaker detection. results show method, requiring user inputs, generate high-quality balloons. studies also demonstrate users prefer generated over those state-of-the-art systems.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Discourse-driven Comic Generation

Narrative generation enables a range of opportunities for understanding the creative act of storytelling. Prior approaches have mostly converged on a pipeline model, wherein story structure is generated as a precursor to discourse structure, mapping individual story events to discourse elements. This model, however, unnecessarily limits narrative possibilities, which most prior work avoids by i...

متن کامل

Automatic Generation of a Multi Agent System for Crisis Management by a Model Driven Approach

Considering the increasing occurrences of unexpected events and the need for pre-crisis planning in order to reduce risks and losses, modeling instant response environments is needed more than ever. Modeling may lead to more careful planning for crisis-response operations, such as team formation, task assignment, and doing the task by teams. A common challenge in this way is that the model shou...

متن کامل

Comic Layout for Automatic Comic Generation from Game Log

The paper presents our system for generating comics from game log. In particular, comic layout is focused. In order to achieve more comic-like expressivity, we extend an existing comic layout process proposed by Shamir et al. as follows. First, tiny frames are introduced for being placed vertically in the same row. Second, splash frames taking up space of several rows are introduced for emphasi...

متن کامل

Automatic Page Object Generation with APOGEN

Page objects are used in web test automation to decouple the test cases logic from their concrete implementation. Despite the undeniable advantages they bring, as decreasing the maintenance effort of a test suite, yet the burden of their manual development limits their wide adoption. In this demo paper, we give an overview of APOGEN, a tool that leverages reverse engineering, clustering and sta...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: ACM Transactions on Multimedia Computing, Communications, and Applications

سال: 2021

ISSN: ['1551-6857', '1551-6865']

DOI: https://doi.org/10.1145/3440053